# Chinese Masked Prediction

This is a BERT model optimized for the agricultural domain, trained using MLM (Masked Language Model) self-supervised learning methods.

A lightweight model based on the BERT architecture, pre-trained using knowledge distillation techniques, with a hidden layer dimension of 256 and 4 attention heads.